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DESCRIPTION 

IMAGE PROCESSING APPARATUS 

Technical Field 
The present invention relates to an image pro- 
cessing apparatus for processing an image input from an 
image input device such as a digital camera. 

Background Art 
In a carrier service called a door-to-door 
delivery service, a computer communication system is 
generally introduced to maintain security for packages 
and realize high-speed operations. 

FIG. 9 schematically shows the flow of a package 
in a carrier service. A package from a sender 91 is 
collected in a cargo collection agent 92. When a 
carrier comes to the cargo collection agent 92 to pick 
up the package, he/she inputs the data (slip number) of 
the package to a handy terminal he/she is carrying. 
The package is then carried to an outgoing office 93. 
In this case, the package data in the handy terminal is 
uploaded into a personal computer installed in the 
outgoing office 93. This package data is transmitted 
from the outgoing office 9 3 to a host computer 98 in a 
head office. The package is sequentially carried to 
an outgoing center 94, an incoming center 95, and an 
incoming office 96 to be delivered to a receiver 97. 
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Every time the package is carried to the outgoing 
center 94, the incoming center 95, and the incoming 
office 96 , the package data is transmitted to the host 
computer 98 in the head office. The host computer 98 
in the head office performs tracking management for the 
package on the basis of the package data until the 
package is delivered to the receiver 97. 

If, for example, the written address or name of 
the receiver is wrong, the package cannot be delivered 
to the receiver. In this case, the package is carried 
back to the incoming office 96 and stored therein until 
the sender 91 or the receiver 97 makes an inquiry about 
the package. When an inquiry about the package is made, 
a search for the package is made by using the package 
tracking data managed by the host computer 9 8 in the 
head office, thereby finding the "addressee unknown" 
package and delivering it to the receiver. 

Upon reception of an inquiry about the package, 
the host computer 98 in the head office searches for 
the package tracking data with the slip number handed 
to the sender 91 to find the "addressee unknown 7 ' 
package. If, however, the sender 91 loses or discards 
the received slip, the operator must go to the 
depository. That is, it takes much time to find the 
package. In this case, therefore, the operator cannot 
give an immediately reply, and must make contact with 
the inquirer afterward. In addition, the package may 
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not be found after a long search. As a result, 
problems are posed in terms of reliability as well as 
security and quick operation. 

It is an object of the present invention to 
analyze the feature of an image of an article and store 
feature data indicating the feature in correspondence 
with the image so as to quickly search for the image of 
the desired article on the basis of the feature data. 

Disclosure of Invention 
According to the present invention , there is 
provided an image processing apparatus for processing 
an input image , comprising: 

image input means for inputting an image of an 
article; 

analyzing means for analyzing a feature of the 
article on the basis of the image of the article which 
is input from the image input means, and obtaining 
feature data indicating the analysis result; 

image storage means for adding the feature data 
obtained by the analyzing means to the image input from 
the image input means, and storing the feature data and 
the image in correspondence with each other; 

designation means for designating feature data to 
be used for a search; and 

search means for searching the image storage means 
for an image corresponding to the feature data desig- 
nated by the designation means, and outputting the 
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image . 

According to the present invention , therefore , the 
feature of an image of the article are analyzed, and 
pieces of feature data indicating the feature are 
stored in correspondence with the image. With this 
operation, the image of the desired article can be 
quickly searched out on the basis of the feature data. 
By only imaging articles in advance, therefore, a 
desired article can be quickly specified from a 
plurality of articles on the basis of the images. 

Additional objects and advantages of the present 
invention will be set forth in the description which 
follows, and in part will be obvious from the descrip- 
tion, or may be learned by practice of the present 
invention. 

The objects and advantages of the present inven- 
tion may be realized and obtained by means of the 
instrumentalities and combinations particularly pointed 
out in the appended claims. 

Brief Description of Drawings 

The accompanying drawings, which are incorporated 
in and constitute a part of the specification, illus- 
trate presently preferred embodiments of the present 
invention and, together with the general description 
given above and the detailed description of the 
preferred embodiments given below, serve to explain the 
principles of the present invention in which: 
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FIG. 1 is a view showing the overall arrangement 
of a computer communication system including an 
embodiment of an image processing apparatus according 
to the present invention; 

FIG. 2 is a view showing the arrangement of the 
terminal apparatus TM in FIG. 1; 

FIG. 3 is a view showing the main arrangement of 
the storage device 3 in FIG. 2; 

FIG. 4 is a view showing the arrangement of the 
image data storage section PT in FIG. 3; 

FIGS. 5A and 5B are flow charts showing an image 
input processing; 

FIG. 6 is a view showing a sample display in an 
image input processing; 

FIGS. 7A to 7C are flow charts showing an image 
search processing; 

FIGS. 8A to 8C are sample displays in the image 
search processing; and 

FIG. 9 is a view showing the flow of a delivery 
package in a conventional carrier service. 

Best Mode of Carrying Out the Invention 
An embodiment of the present invention will be 
described below with reference to FIGS. 1 to 8C. 

FIG. 1 schematically shows the arrangement of part 
of a computer communication system constructed in a 
carrier service and including an image processing 
apparatus according to an embodiment of the present 
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invention. 

A host computer HT installed in a head office for 
administering domestic centers and offices exchanges 



TM installed in outgoing centers, incoming centers, 
incoming offices, and the like through public telephone 
lines, and collects/manages the data transmitted from 
the respective terminal apparatuses TM. 

FIG. 2 is a block diagram showing the overall 
arrangement of the terminal apparatus TM installed in 
each of the centers and offices. 

A CPU 1 is a central processing unit for control- 
ling the overall operation of the terminal apparatus TM 
in accordance with various programs stored in a program 
memory (not shown). A storage device 3 has a storage 
medium 4 in which programs, data, and the like are 
stored. This storage medium 4 is a magnetic or optical 
storage medium or a semiconductor memory. The storage 
medium 4 is permanently or detachably mounted in the 
storage device 3. The programs, data, and the like 
to be stored in the storage medium 4 may be received 
and stored from another device connected through a 
communication line or the like. Alternatively, the 
storage device 3 having the storage medium 4 may be 
mounted on another device side which is connected 
through the communication line or the like so that the 
programs and data stored in the storage medium 4 are 
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used through the communication line. When a program 
and data are transmitted from another device through a 
communication control section 5, the CPU 1 receives the 
program and the data and stores them in the storage 
device 3. In addition, an input device 6, a display- 
device 7, and an image input device 8 are connected as 
peripheral devices to the CPU 1. The CPU 1 controls 
the input/output operations of these devices. 

The image input device 8 has a keyboard and a 
pointing device. Various conventional keys are 
arranged on the keyboard, which is used to input 
character string data and commands. In this case, the 
character string data input from the input device 6 is 
displayed/output onto the display device 7 or stored in 
the RAM 2. Upon reception of an image input command 
from the input device 6, the CPU 1 receives the image 
data from the image input device 8 and stores it in the 
RAM 2. The image input device 8 is an electronic still 
camera (digital camera) having a solid-state image 
pickup element (CCD image sensor or the like), and is 
detachably connected to the terminal apparatus TM. The 
image input device 8 images an object (the contents of 
an " addressee unknown" package) as a color image and 
stores/holds it in its internal image memory. The 
CPU 1 fetches the image from the image input device 8 
and displays/outputs onto the display device 7 or 
temporarily stores it in the RAM 2. The image input 
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device 8 has a timepiece function. When, therefore, 
the image input device 8 images an « addressee unknown" 
package, the current date data obtained by the time- 
piece function is stored in the image memory in the 
image input device 8 in correspondence with the image, 

FIG. 3 shows part of the storage device 3. The 
storage device 3 has a color data table CT, a size data 
table ST, and an image data storage section PT. The 
color data table CT is used to permanently store 
various color data. The CPU 1 compares the image 
fetched from the image input device 8 with the contents 
of the color data table CT to determine the color of 
the image. In this case, the main color (the dominant 
color in terms of area and most stimulating) of the 
image is determined as its image color. Note that in 
determining the color of the image, an approximate 
color like a reddish or bluish color may be determined. 
The size data table ST is used to permanently store 
data indicating various sizes. For example, a plural- 
ity of types of frame patterns such as square and 
rectangular patterns are stored as data indicating 
sizes. The CPU 1 compares the size of the image 
fetched from the image input device 8 with the contents 
of the size data table ST to determine the size of the 
image. In this case, each article is imaged by the 
image input device 8 at an almost constant distance 
(about 1 m) from each article. The image data storage 
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section PT is used to store the image input from the 
image input device 8. Various pieces of link data are 
set in correspondence with the images in the image data 
storage section PT. Note that the contents of the 
color data table CT, the size data table ST, and the 
image data storage section PT are loaded from the 
storage device 3 into the RAM 2 . 

FIG. 4 shows the arrangement of the image data 
storage section PT. 

The image data storage section PT is designed to 
store "article name", "color", "size", "date", "image", 
and "other features". in this case, "article name" 
indicates the type of each "addressee unknown" package. 
The character string data (article name) input from the 
input device 6 is stored in the image data storage 
section PT as link data corresponding to each image. 
In addition, "color" and "size" are data which are • 
automatically determined by analyzing images and 
comparing the analysis results with the contents of the 
color data table CT and the sizefdata table~~STT] These 
data are stored in the image data storage section PT as 
pieces of link data corresponding to the respective 
images. "Date" indicates the date when each "addressee 
unknown" package was imaged. The CPU 1 fetches the 
date data corresponding to an image from the image 
input device 8, and stores it in the image data storage 
section PT. The data indicating "other features" are 
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also arbitrarily input from the input device 6 as 
character string data. For example, data indicating 
the appearance feature of packages, e.g., "pattern", 
"material", and "shape", are stored in the image data 
storage section PT as pieces of link data corresponding 
to the respective images. 

The operation of this terminal apparatus TM will 
be described next with reference to the flow charts of 
FIGS. 5A and 5B and FIGS. 7A, 7B, and 7C. Note that 
the programs for implementing the functions described 
in these flow charts are stored in the storage medium 4 
in the form of program codes which can be read by the 
CPU l f and the contents of these programs are loaded 
into the program memory in the RAM 2 . 

In keeping an "addressee unknown" package, the 
operator extracts an article from the package, and 
images the article with the image input device 8 at an 
almost constant distance. The operator inputs an image 
input command through the input device 6 while the 
image input device 8 is connected to the terminal 
apparatus TM. The operation is then executed/started 
in accordance with the flow charts of FIGS. 5A and 5B. 

More specifically, the CPU 1 reads a one-frame 
image from the image input device 8 (step Al), and 
stores it in the image data storage section PT (step 
A2). The CPU 1 analyzes the image and compares the 
analysis result with the contents of the color data 
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table CT (step A3). If, for example, the main color of 
the image like a three-color pattern image cannot be 
determined as a result of comparison (NO in step A4 ) , 
guidance display is performed to request the operator 
to input /designate an image color. When color data is 
input in response to this prompt (step A5), the color 
data is set in the image data storage section PT as 
link data corresponding to the image (step A6 ) . If the 
main color of the image can be determined as a result 
of comparison (YES in step A4 ) , the determined color 
data is set in the image data storage section PT as 
link data corresponding to the image (step A7). 

Subsequently, the CPU 1 determines the size of the 
image by comparison with the contents of the size data 
table ST (step A8). In this case, if, for example, the 
image is excessively large or small, and the size of 
the image cannot be determined (NO in step A9 ) , a 
message for requesting the operator to input size data 
is displayed. When size data is input in response to 
this prompt (step A10), the size data is set in the 
image data storage section PT (step All). If the size 
of the image can be determined (YES in step A9), the 
determined size data is set in the image data storage 
section PT (step A12). 

When setting of the color and size of the image as 
pieces of link data corresponding to the image in the 
image data storage section PT is complete in this 
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manner, the flow advances to step A13 in FIG. 5B to 
fetch the imaging date and set it in the image data 
storage section PT as link data corresponding to the 
image. Thereafter, a message for requesting the 
operator to input an article name with the input device 
6 is displayed. When an article name is input in 
response to this prompt (step A14), the article name is 
set in the image data storage section PT (step A15). 
If the article is further observed, and another feature 
associated with the pattern, material, shape, or the 
like of the article is found, the feature is input as 
other feature data (step A16). The input feature data 
is set in the image data storage section PT (step A17). 

After various pieces of link data are set in the 
image data storage section PT in correspondence with 
the image, the contents of the image data storage 
section PT are registered/held in the storage device 3 
(step A18), and are transmitted to the host computer HT 
through the communication control section 5 (step A19) . 
If there are a plurality of frames of images, pieces of 
link data are set in the image data storage section PT 
in units of images, and are registered/held in the 
storage device 3 or transmitted to the host computer HT. 
FIG. 6 shows a screen display in such an image input 
operation. Every time link data is determined or input, 
the corresponding contents are displayed/output, 
together with the image. 
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Assume that a sender or receiver makes an inquiry 
about a package , and the sender has lost or discarded 
the slip. In this case, the "addressee unknown 7 ' 
packages in safekeeping are searched for the desired 
package. In this operation, search processing for 
specifying the package from an image is performed in 
accordance with the flow charts of FIGS. 7A to 7C. 
Upon reception of this search command from the input 
device 6, the CPU 1 reads out the contents of the image 
data storage section PT from the storage device 3/ 
loads them into the RAM 2, and performs the operation 
based on the flow charts. 

First, the operator inquires of the sender or ■■ 
receiver about the article name, and inputs the article 
name through the input device 6 (step Bl). In response 
to this operation, the CPU 1 searches the image data 
storage section PT (step B2) , and checks whether images 
having the input article name are present (step B3). 
If the images having the input article name are present, 
the CPU 1 displays them on the display screen in the 
form of a list (step B4). FIG. 8A shows a screen 
display in a case wherein "bag" is input as an article 
name. If a desired image is included in this list of 
images, the operator moves the cursor to the position 
of the image to select it, and operates the OK key 
(selection execution key) (step B5). 

If the desired image cannot be specified by only 
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the article name, the flow advances to step B6 to input 
color data through the input device 6. If there are no 
images having the input article name (NO in step B3), 
the steps B4 and B5 are skipped. That is, all images 
are selected and the flow advances to the step of 
inputting color data (step B6). 

When the operator makes an inquiry about the color 
and inputs color data through the input device 6, the 
CPU 1 searches the image data storage section PT for 
images corresponding to the currently input color data 
among the images having the input article name (step 
B7). If the CPU 1 checks whether images having the 
input color are present (step B8) . If the images 
having the input color are present, the CPU 1 extracts 
only those images and displays them in the form of a 
list (step B9). FIG, 8B shows a screen display in this 
case, in which only the blue bags are extracted from 
the bags and displayed in the form of a list. If the 
operator can find a desired image, he/she moves the 
cursor to the position of the desired image and 
operates the OK key (step BIO). 

If the desired image cannot be specified by only 
the article name and the color, the flow further 
advances to step Bll to input size data through the 
input device 6. In this case, as the size data, 
numerical data like "some cm long and some cm wide" is 
input. If NO in step B8, steps B9 and BIO are skipped 
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and the flow advances to the step of inputting size 
data (step Bll) . 

In this case, the CPU 1 searches the size data 
table ST on the basis of the input size data. If the 
article name and the color have already been input as 
search data, the CPU 1 searches the image data storage 
section PT for images having the currently input size 
among the images having the input article name and the 
input color (step B12). If the images having the 
currently input size are present (YES in step B13), the 
CPU 1 extracts only those images and displays them in 
the form of a list (step B14). FIG. 8C shows a screen 
display in this case, in which the large bag is 
extracted from the blue bags and displayed. In this- 
case, only one image is extracted. If this image 
coincides with the desired package, the OK key is 
operated (step B15). 

If there are several large bags are extracted from 
the blue bags but the desired image cannot be specified 
by only the article name, the color, and the size, the 
flow further advances to step B16. If NO in step B13, 
the steps B14 and B15 are skipped and the flow further 
advances to step B16 . 

In step B16, the operator inputs date data through 
the input device 6. The CPU 1 then searches the image 
data storage section PT on the basis of the date data 
(step B17). If images having the input date are 
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present (step B18), the CPU 1 displays them in the form 
of a list (step B19). If the desired image is present 
in this list, the operator selects it and operates the 
OK key (step B20). If the desired image is not present, 
the operator inputs other feature data (step B21) . 
Subsequently, the image data storage section PT is 
searched on the basis of the input feature data in the 
same manner as described above (step B22). If corre- 
sponding images are present (step B23), the CPU 1 
displays them in the form of a list (step B24). If the 
OK key is not operated either in this case (NO in step 
B25), guidance display is performed to indicate the 
absence of a corresponding image. That is, if there is 
no corresponding image even after the input of the 
article name, the color, the size, the date, and other 
feature data, guidance display is performed to inform 
it. If the OK key is operated in step B5 , BIO, B15, 
B20, or B25, the flow advances to step B2 7 to read 
out the selected/confirmed image from the image data 
storage section PT, together with the corresponding 
pieces of link data, and display/output them. 

As described above, in keeping an "addressee 
unknown" package, the operator in the incoming office 
or the like images the package with the image input 
device 8. This image is stored in the image data 
storage section PT in the terminal apparatus TM. In 
this case, the color and size of the image are 



WO 98/228 



WO 98/22888 . 



17 



PCT/JP97/04093 



determined and set in the image data storage section PT 
as pieces of link data corresponding to the image. i n 
addition, the article name and other feature data input 
from the input device 6 or the automatically generated 
date data as well are set in the image data storage 
section PT as pieces of link data corresponding to the 
image. When the operator inputs an article name, a 
color, a size, a date, and other features as pieces of 
link data upon inquiry from a sender or receiver, the 
contents of the image data storage section PT are 
searched every time link data is input, and the search 
results are displayed as a list of images. In this 
case, every time link data is input, objects to be 
searched out are gradually narrowed down. The desired 
package can therefore be easily specified. That is, 
the operator can immediately reply to the inquiry on 
the spot without going to the depository, resulting in 
an improvement in service. In addition, the operator 
directly inputs an article name, a color, a size, and 
the like to make searches while receiving an inquiry by 
telephone, and the results are displayed as images. 
Therefore, a confirmation error can be effectively 
prevented, and a delivery error due to a confirmation 
error can be prevented. 

In the first embodiment described above, the 
search processing shown in FIGS. 7A to 7C is performed 
by the terminal apparatus TM installed in an incoming 
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center , an incoming office, or the like. This 
processing, however, may be performed by the host 
computer HT in the head office. In this case, in 
transmitting images and various pieces of link data 
from an incoming center or an incoming office which 
keeps "addressee unknown" packages to the host computer 
HT, if the center name or office name indicating the 
depository is added as link data, data indicating the 
depository can be displayed, together with the image, 
in display processing upon operation of the OK key. 
This allows the head office to quickly give a delivery 
instruction to the center or office. 



According to the present invention, the image 
processing apparatus analyzes the feature of an image 
of an article and stores feature data indicating the 
feature in correspondence with the image so as to 
quickly search for the image of the desired article on 
the basis of the feature data. 



Industrial Applicability 



9822888A1 I > 



WO 98/22888 . 



19 



PCT/JP97/04093 



CLAIMS 

1. An image processing apparatus for processing 
an input image, comprising: 

image input means for inputting an image of an 
article;. 

^ an alyzing means for analyzing a feature of the 
article based on the image of the article which is 
input from said image input means , and obtaining 
feature data indicating a result of analysis; 

image storage means for storing the feature data 
and the image in correspondence with each other; 

designation means for designating feature data to 
be used for a search; and 

search means for searching said image storage 
means for an image corresponding to the feature data 
designated by said designation means, and outputting: a 
searched image. 

2. An apparatus according to claim 1, in which 
said analyzing means obtains feature data indicating a 
color of an article. 

3. An apparatus according to claim 1, in which 
said analyzing means obtains feature data indicating a 
size of an article. 

4. An apparatus according to claim 1, in which 
said search means displays the searched image on a 
display screen. 

5. An apparatus according to claim 4, in which 
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when said search means searches out a plurality of 
images corresponding to the feature data designated by- 
said designation means , said search means displays the 
plurality of images on the display screen in the form 
5 of a list. 

6. An apparatus according to claim 5, in which 
when another feature data is designated by said 
designation means after the plurality of images are 
displayed on the display screen in the form of a list, 

10 said search means displays only an image corresponding 

to said another feature data. 

7. An apparatus according to claim 1, further 
comprising: 

data input means for inputting data indicating a 
15 feature of an article; and 

control means for causing said image storage means 
to store the data input from said data input means in 
correspondence with the image. 

8. An apparatus according to claim 7, in which 
20 when data indicating a feature of an article is 

designated as search data, said search means searches 
said image storage means for the image on the basis of 
the search data. 

9 . A storage medium storing computer-readable 
25 program codes, comprising: 

a program code for analyzing a feature of an 
article based on an input image of the article, and 
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obtaining feature data indicating a result of analysis; 

a program code for storing the feature data and 
the input image in correspondence with each other; 

a program code for designating feature data to be 
used for a search; and 

a program code for searching a plurality of input 
images for an image corresponding to a designated 
feature data, and outputting a searched image. 

10. An image processing apparatus for processing 
an input image, comprising: 

image input means for inputting an image of an 
article; 

analyzing means for analyzing a feature of the 
article based on the image of the article which is 
input from said image input means, and obtaining 
feature data indicating a result of analysis; and 

image storage means for storing the feature data 
and the image in correspondence with each other. 

11. An apparatus according to claim 10, in which 
said analyzing means obtains feature data indicating a 
color of an article. 

12. An apparatus according to claim 10, in which 
said analyzing means obtains feature data indicating a 
size of an article. 

13. An apparatus according to claim 10, further 
comprising: 

designation means for designating feature data to 
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be used for a search; and 

search means for searching said image storage 
means for an image corresponding to the feature data 
designated by said designation means, and outputting a 
searched image. 

14. An apparatus according to claim 13, in which 
said search means displays the searched image on a 
display screen. 

15. An apparatus according to claim 14, in which 
when said search means searches out a plurality of 
images corresponding to feature data designated by said 
designation means, said search means displays the 
plurality of images on the display screen in the form 
of a list. 

16. An apparatus according to claim 15, in which 
when another feature data is designated by said 
designation means after the plurality of images are 
displayed on the display screen in the form of a list, 
said search means displays only an image corresponding 
to said another feature data. 

17. An apparatus according to claim 10, further 
comprising: 

data input means for inputting data indicating a 
feature of an article; and 

control means for causing said image storage means 
to store the data input from said data input means in 
correspondence with the image. 
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18. An apparatus according to claim 17, in which 
when data indicating a feature of an article is 
designated as search data, said search means searches 
said image storage means for the image on the basis of 
the search data. 
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